Skip to content

[CI/Build] Add L5 stability and reliability test framework#1

Merged
Abdeltoto merged 2 commits into
mainfrom
ci/l5-stability-reliability-framework
Feb 23, 2026
Merged

[CI/Build] Add L5 stability and reliability test framework#1
Abdeltoto merged 2 commits into
mainfrom
ci/l5-stability-reliability-framework

Conversation

@Abdeltoto
Copy link
Copy Markdown
Owner

Purpose

Scaffold the L5 tier of the CI/CD plan (issue vllm-project#400) by adding the missing stability and reliability test frameworks.

  • Split L5 into (a) long-run stability and (b) recovery/chaos tests
  • Add tests/e2e/stability/ with weekly.json config and monitoring helpers
  • Add tests/e2e/reliability/ with fault-injection helpers and recovery test template
  • Update CI_5levels.md with concrete examples (replacing WIP placeholder)
  • Document diffusion/audio quality regression signals approach (CLIP/wav2vec embeddings)

Test Plan

  • Verify pytest --collect-only tests/e2e/stability/ collects without errors
  • Verify pytest --collect-only tests/e2e/reliability/ collects without errors
  • Review docs/contributing/ci/CI_5levels.md renders correctly with mkdocs serve

Test Result

Framework scaffolding only - no GPU-dependent tests executed yet. Full L5 tests require weekly CI infrastructure.

Abdeltoto and others added 2 commits February 15, 2026 16:30
…ect#400)

Signed-off-by: Abdeltoto <paypalbio360@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Signed-off-by: Abdeltoto <paypalbio360@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
@Abdeltoto Abdeltoto merged commit 1bb0931 into main Feb 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant